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@ Apparatus for segmenting encoded video signals for transmission. 

i 

@ A video signal encoding system includes ap- 
paratus for segmenting encoded video data into 
transport blocks for signal transmission. The 
transport block format enhances signal recov- 
ery at the receiver by virtue of providing header 
data from which a receiver can determine re- 
entry points into the data stream on the occurr- 
ence of a loss or corruption of transmitted data. 
The number of re-entry points are maximized by 
providing secondary transport headers embed- 
ded within encoded video data in respective 
transport blocks. 
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This invention relates to a system for providing 
and processing a high definition television (HDTV) 
signal, and more particularty to apparatus for seg- 
menting compressed video data into blocks of data for 
transmission. 

Background of the Invention 

Digital high definition video data may be success- 
fully transmitted over terrestrial television channels, 
as described herein, by partitioning the video data be- 
tween high and low priority information, and quadrat- 
ure amplitude modulating the high and low priority 
data on separate carriers respectively. The modu- 
lated carriers are Included in a 6 MHZ frequency spec- 
trum and then the combined signal is translated to 
occupy a standard broadcast channel spectrum. The 
high priority data is transmitted with relatively high 
power and the low priority data with relatively low 
power. High priority data is that video data which is 
sufficient to reproduce an image, albeit of lesser qual- 
ity than a high definition image. 

Nominally digital video data is compressed and 
transmitted in layered coded format including header 
data identifying respective portions of the data so that, 
upon loss of. some data during transmission, the 
receiver can find an appropriate re-entry point in the 
received data. In general, however, simply providing 
header data is not sufficient to enable the receiver to 
produce acceptable images, since it may be the 
header data which is lost or corrupted during trans- 
mission. In such instances the receiver will tend to 
lose synchronization with respect to the normal cycli- 
cal decoding sequence. 

In accordance with the present invention extra 
protection against lost or corrupted data from confus- 
ing decoding at the receiver, is provided by arranging 
coded video data in transport blocks. The transport 
blocks include additional header data identifying rela- 
tively small portions of the video data. In addition the 
header data of the transport blocks includes pointers 
which indicate data re-entry points within respective 
transport blocks. 

The present invention is directed to circuitry for 
forming video data transport blocks at a video signal 
encoder and circuitry for depacketizing the transport 
blocks at a video signal receiver. 

For purposes of this disclosure the video data will 
be presumed to be compressed in MPEG like format. 
What is meant by "MPEG like" is a coding format simi- 
lar to the standardized coding format being 
established by the International Organization for 
Standardization.. The standard is described in the 
document "Intemational Organization for Standardi- 
zation", ISO-IEC JT(1/SC2/WG1), Coding of Moving 
Pictures and Associated Audio. MPEG 90/176 Rev.2. 
Dec. 18. 1990, which document is incorporated herein 
by reference for description of the general code for- 



mat. 

The MPEG standard transmits 240 lines (NTSC) 
per frame non-interiaced, which is typically accom- 
plished by encoding only the odd or even fields of an 
5 interfaced source video signal. For transmitting HDTV 
signals the standard is modrfted to provide, for 
example 480 lines per field, and both the odd and 
even fields are transmitted. In addition the number of 
pixels per line is increased to for example 1440. Con- 
to ceptually these changes only affect the data rate and 
do not affect the compression philosophy. 

Summary of the Invention 

15 In a first embodiment of the present invention, in 

a video signal encoding system, wherein the encoded 
video signal occurs, at least in part, as a succession 
of groups of data (e.g.. slices), in which each group 
includes a plurality of subgroups (e.g., blocks) of inter- 

20 dependent coded data representing a contiguous 
area of an image, apparatus is provided for arranging 
encoded video signal data in transport blocks. The 
apparatus includes a source of encoded video signal 
data and first circuit means responsive to the encoded 

25 video signal data, for dividing the encoded video data 
into segments of substantially equal amounts of data, 
respective segments representing encoded video 
data to be included in respective transport blocks and 
including video data from one or more of the groups, 

30 and wherein subgroups of data from ones of the 
groups may be in more than one segment A second 
circuit means, generates transport headers including 
information to identify first occurring groups of data in 
respective segments, and generates further headers 

35 including information identifying second occurring 
groups of data in respective segments which include 
data from first and second groups of data. The further 
headers are located between first and second groups 
of data in respective transport blocks, and the second 

40 circuit means also generates, and includes in respec- 
tive transport headers, infomnation indicating the loca- 
tion of the further headers in respective transport 
blocks. A third circuit mean, cooperates with the first 
and second circuit means, for multiplexing respective 

45 transport headers with corresponding segments and 
further headers to form partial transport blocks, with 
respective transport headers located in a predeter- 
mined location in the respective transport blocks. An 
error encoding means , responsive to header infor- 

50 mation and encoded video data in respective partial 
transport blocks, generates error check codes over 
respective partial transport blocks, and appends the 
error check codes to corresponding partial transport 
blocks to form the transport blocks. 

55 The present invention is further embodied in a 

video signal system for processing encoded video 
signal data conveyed in transport blocks, with the 
transport blocks including a first transport header TH 
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in a predetermined transport block location and a sec- 
ond transport header RH placed at variable locations 
within the transport blocks. The variable location is 
identified by a pointer in the first transport header, and 
an error check code is located in a predetenmined 
location in the transport block. The processing system 
has apparatus including, circuit means for receiving 
and providing the conveyed transport blocks. An error 
check means, is responsive to the received transport 
blocks for performing an error check on respective 
transport blocks in cooperation with associated error 
check codes, and provides an error indicating signal 
upon the detection of bit enrors in the transport blocks. 
A control means, coupled to the enror check means, 
excises the error check codes from respective trans- 
port blocks, extracts the transport header TH from res- 
pective transport blocks and detenmines therefrom 
the location within the transport blocks of the transport 
headers RH, and extracts the transport header RH 
from respective transport blocks. The control means 
also includes circuit means for providing encoded 
video signal included within the transport blocks exc- 
lusive of the extracted transport block headers and 
the error check codes. 

Brief Description of the Drawings 

FIGURE 1 is a block diagrams of an HDTV encod- 
ing/decoding system embodying the invention. 

FIGURES 1 B - 1 C are pictorial representations of 
sequences of fields/frames of encoded video signal 
useful in describing the invention. 

FIGURE 2 is a pictorial representation of a mac- 
roblock of data provided by the compression circuit of 
FIGURE 3. 

FIGURE 3 is a block diagram of a video signal 
compression circuit. 

FIGURE 3A is a generalized pictorial represen- 
tation of the data format provided by the compression 
circuit of FIGURE 3. 

FIGURE 4 is a block diagram of exemplary cir- 
cuitry which may be utilized for the formatting circuit 
111 of FIGURE 3. 

FIGURE 5 is a block diagram of exemplary cir- 
cuitry which may be implemented for the Priority 
Select circuitry of FIGURE 1. 

FIGURE 5A is a flow diagram illustrating the oper- 
ation of the FIGURE 5 analyzer. 

FIGURE 6 is a diagram of the signal format pro- 
vided by the transport processor 12 of FIGURE 1. 

FIGURE 7 is a block diagram of exemplary cir- 
cuitry which may be implemented for the Transport 
Process circuit of FIGURE 1. 

FIGURE 8 is a block diagram of exemplary cir- 
cuitry which may be implemented for the transport 
processor 25 of FIGURE 1. 

FIGURE 9 is a block diagram of exemplary cir- 
cuitry which may be implemented for the priority 



deselect circuit 26 of FIGURE 1 . 

FIGURE 10 is a block diagram of exemplary cir- 
cuitry which may be implemented for the decompres- 
sion circuit 27 of FIGURE 1. 
5 FIGURE 11 is a block diagram of exemplary cir- 

cuitry which may be implemented for the MODEMS 17 
and 20 of FIGURE 1. 
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Detailed Description 



An exemplary HDTV system which may be sup- 
ported by the present Invention includes a two-to-one 
interlaced signal of 1050 lines at 59.94 frames per 
second. The nominal active picture has 960 lines of 

15 1440 pixels each with an aspect ratio of 16 x 9. The 
signal is transmitted using two 64 quadrature ampli- 
tude modulated (64-QAM) carriers, frequency multip- 
lexed in a 6 MHz transmission band. The nominal total 
bit rate, including video, audio and auxiliary data, is 

20 26-29 Mbps. 

The video signal is initially compressed in con- 
formance with an MPEG-like fomnat, albeit using both 
fields of each frame and with higher pixel density. 
Thereafter the MPEG-type signal codewords are 

25 parsed into two bit streams in accordance with the 
relative Importance of the respective codeword types. 
The two bit streams are independently processed to 
apply error correction overhead bits, and then caused 
to QAM respective carriers. The modulated carriers 

30 are combined for transmission. The bit streams of 
relatively greater and lesser importance are desig- 
nated high priority (HP) and low priority (LP) channels 
respectively. The high priority channel is transmitted 
with approximately twice the power as the lower 

35 priority channel. The high priority/low priority infor- 
mation ratio is approximately one-to-four. The 
approximate net data rates after forward error correc- 
tion are 4.5 Mbps HP and 18 Mbps LP. 

FIGURE 1 illustrates an exemplary HDTV encod- 

40 ing/decoding system according to the invention. FIG- 
URE 1 shows the system processing a single video 
input signal, but it is to be understood that the lumi- 
nance and chrominance components are compres- 
sed separately, and that the luminance motion 

45 vectors are utilized for generating compressed 
chrominance components. The compressed lumi- 
nance and chrominance components are interleaved 
to form macroblocks before codeword priority parsing. 
A sequence of image fields/frames as per FIG- 

50 URE IB is applied to circuitry 5 which reorders the 
fields/frames according to FIGURE 1C. The reor- 
dered sequence is applied to a compressor 10 which 
generates a compressed sequence of frames that are 
coded according to an MPEG-like format This format 

55 is hierarchical and is illustrated in abbreviated form in 
FIGURE 3A. 

The MPEG hierarchical format includes a plurality 
of layers each with respective header information. 
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Nominally each header includes a start code, data 
related to the respective layer and provision for 
adding header extensions. Much of the header infor- 
mation (as indicated in the referenced MPEG docu- 
ment) is required for synchronization purposes in an 
MPEG systems environment For purposes of provi- 
ding a compressed video signal for a digital HDTV 
simulcast system, only descriptive header information 
is required, that is start codes and optional extensions 
may be excluded. The respective layers of the coded 
video signal are illustrated pictorialty in FIGURE 2. 

When referring to the MPEG-like signal produced 
by the present system what is meant is that a) succes- 
sive fields/frames of video signal are encoded accord- 
ing to an I, P, B coding sequence, and b) coded data 
at the picture level is encoded in MPEG-like slices or 
group of blocks albeit that the number of slices per 
field/frame may differ and the numberof macro blocks 
per slice may differ. An I coded frame is one which is 
intraframe compressed such that only I frame com- 
pressed data is required to reproduce an image. P 
coded frames are coded according to a forward 
motion compensated predictive method, that is the P 
frame coded data is generated from the current frame 
and an I or P frame occurring before the current frame. 
B coded frames are coded according to a bidirec- 
tionally motion compensated predictive method. The 
B coded frame data is generated from the current 
frame and from I and P frames occuning both before 
and after the current frame. 

The coded output signal of the present system is 
segmented in groups of fields/frames (GOF) illus- 
trated by the row of boxes L1 (FIGURE 3A). Each 
GOF (L2) includes a header followed by segments of 
picture data. The GOF header includes data related 
to the horizontal and vertical pjcture size, the aspect 
ratio, the field/frame rate, the bit rate, etc. 

The picture data (L3) conresponding to respective 
fields/frames includes a header followed by slice data 
(L4). The picture header includes a field/frame nunv 
ber and a picture code type. Each slice (L4) includes 
a header followed by a plurality of blocks of data MBi. 
The slice header includes a group number and a 
quantization parameter. 

Each block MBi (L5) represents a macroblock and 
includes a header followed by motion vectors and 
coded coefficients. The MBI headers include a mac- 
roblock address, a macroblock type and a quanti- 
zation parameter. The coded coefficients are 
illustrated in layer L6, Note each macroblock is conv 
prised of 6 blocks, including four luminance blocks, 
one U chrominance block and one V chrominance 
block. See FIGURE 2. A block represents a matrix of 
pixels, e.g., 8x8 over which a discrete cosine trans- 
form (OCT) is perfomned. The four luminance blocks 
are a 2 x 2 matrix of contiguous luminance blocks rep- 
resenting, e.g., a 16 X 16 pixel matrix. The chromi- 
nance (U and V) blocks represent the same total area 
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as the four luminance blocks. That is the chrominance 
signal is subsampled by a factor of two horizontally 
and vertically relative to luminance, before compres- 
sion. A slice of data corresponds to data representing 
5 a rectangular portion of an image corresponding to an 
area represented by a contiguous group of macrot>- 
locks. 

The block coefficients are provided one block at 
a time with the DOT, DC coefficient occurring first foi- 

10 lowed by respective DCT AC coefficients in the order 
of their relative importance. An end of block code EOB 
is appended at the end of each successively occurring 
block of data. 

The amount of data provided by the compressor 

15 10 is determined by the rate control element 18. As is 
well known compressed video data occurs at variable 
rates, and desirably, data is transmitted at a constant 
rate equivalent to the channel capacity, to realize effi- 
cient use of the channel. Rate buffers 13 and 14 per- 

20 form the variable to constant data rate translation. It 
is also known to adjust the amount of data provided 
by the compressor in accordance with the level of 
occupancy of the buffers. Thus the buffers 13 and 14 
include circuitry to indicate their respective level of 

25 occupancy. These indications are applied to the rate 
controller 18 to adjust the average data rate provided 
by the compressor 10. The adjustment is typically 
accomplished by adjusting the quantization applied to 
the DCT coefficients. Quantization levels may be dif- 

30 ferent for the different types of frame compression. 
Details of an exemplary method for determining quan- 
tization levels may be found in application 
Sn.494,098, filed 15 March 1990 and entitled"Digital 
Signal Coding With Quantization Level Compu- 

35 tations," which application is included herein by refer- 
ence. 

Compressed video data hierarchically formated 
as indicated in FIGURE 3A is coupled to a priority 
select element 11, which parses the coded data be- 

40 tween a high priority channel HP and a low priority 
channel LP. High priority information is that infor- 
mation, the loss or corruption of which, would create 
the greatest degradation in reproduced images. 
Stated conversely, it is the least data needed to create 

45 an image, albeit less than a perfect image. Low 
priority infomnation is the remaining information. The 
high priority information includes substantially all of 
the header information included in the different hierar- 
chical levels plus the DC coefficients of the respective 

50 blocks and a portion of the AC coefficients of the res- 
pective blocks (level 6, FIGURE 3A). 

The ratio of HP and LP data at the transmitter is 
approximately 1:4. At the transport processor 
auxiliary data is added to the signal to be transmitted. 

55 This auxiliary signal may include digital audio signal 
and, e.g., teletext data. In this example at least the 
digital audio will be included in the HP channel. The 
average amount of the auxiliary data included in the 
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HP channel is calculated and compared to the expec- 
ted statistical average of the compressed video infor- 
mation. From this the ratio of high and low priority 
compressed video information is calculated. The 
priority select element parses the data provided by the 
compressor 10 according to this ratio. 

The HP and LP compressed video data are coup- 
led to a transport processor 1 2 which a) segments the 
HP and LP data streams into transport blocks, b) per- 
forms a parity or cyclic redundancy check on each 
transport block and appends the appropriate parity 
check bits thereto, and c) multiplexes the auxiliary 
data with the HP or LP video data. The parity check 
bits are utilized by the receiver for isolating en-ors in 
conjunction with synchronizing header information 
and for providing error concealment in the event of 
uncorrectable bit errors in the received data. Each 
transport block includes a header including infor- 
mation indicative of the type of information included in 
the block, e.g., video audio and pointers to the starting 
points of contiguous like data. 

The HP and LP data streams from the transport 
processor 1 2 are applied to the respective rate buffers 
13 and 14. which convert the variable rate compres- 
sed video data from the processor 12 to data occur- 
ring at a substantially constant rate. The rate adjusted 
HP and LP data are coupled to forward error encoding 
elements 15 and 16 which a) perform REED SOLO- 
MON forward enror correction encoding indepen- 
dently to the respective data streams; b) interleave 
blocks of data to preclude large error bursts from cor- 
rupting a large contiguous area of a reproduced 
image; and c) appends, e.g.. Barker codes to the data 
for synchronizing the data stream at the receiver. 
Thereafter the signals are coupled to a transmission 
modem 17 wherein the HP channel data quadrature 
amplitude modulates a first carrier and the LP channel 
data quadrature amplitude modulates a second car- 
rier displaced from the first carrier by approximately 
2.88 MHz. The 6 dB bandwidth of the modulated first 
and second carriers are respectively about .96 MHz 
and 3.84 MHz. The modulated first carrier is transmit- 
ted with approximately 9 dB greater power than the 
modulated second carrier. Since the HP information 
is transmitted with greater power it is much less prone 
to corruption by the transmission channel. The HP 
carrier is located in the portion of the frequency spec- 
trum of an, e.g., NTSC TV, transmission channel nor- 
mally occupied by the vestigial sideband of a standard 
NTSC TV signal. This portion of the signal channel is 
normally significantly attenuated by the Nyquist filters 
of standard receivers and thus HDTV signals with this 
transmission format will not introduce cochann el inter- 
ference. 

At the receiver the transmitted signal is detected 
by the modem 20 which provides two signals corre- 
sponding to the HP and LP channels. These two sig- 
nals are applied to respective REED SOLOMON enror 
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correcting decoders 21 and 22. The enror corrected 
signals are coupled to rate buffers 23 and 24 which 
receive data at a variable rate commensurate with the 
reqtiifements of the subsequent decompression cir- 

5 cuitry. The variable rate HP and LP data is applied to 
a transport processor 25 which performs the inverse 
process of the processor 12. In addition it performs a 
degree of error detection responsive to the parity 
check bits included in the respective transport blocks. 

10 The transport processor 25 provides separated 
auxiliary data, HP data, LP data and an error signal 
E. The latter three signals are coupled to a priority 
deselect processor 26 which reformats the HP and LP 
data into an hierarchically layered signal which is 

15 applied to a decompressor 27. The decompressor 27 
performs the inverse function of the compressor 27. 

FIGURE 3 illustrates an exemplary compressor 
apparatus which may be utilized for element 10 of 
FIGURE 1, for providing hierarchically layered com- 

20 pressed video data. The apparatus shown only 
includes the circuitry required to generate compres- 
sed luminance data. Similar apparatus is required to 
generate compressed chrominance U and V data. In 
FIGURE 3 there are elements 104 and 105 desig- 

25 nated as elements for computing forward and back- 
ward motion vectors respectively. Since whether a 
motion vector is forward or backward depends only 
upon whether the current field is analyzed with res- 
pect to a prior or succeeding field, both elements are 

30 realized with similar circuitry, and in fact both ele- 
ments 104 and 105 alternate on a field/frame basis 
between generating forward and backward vectors. 
The elements 104 and 105 may be realized using inte- 
grated circuits of the type designated STI 3220 

35 MOTION ESTIMATION PROCESSOR available from 
SGS-THOMSON MICROELECTRONICS. In order to 
achieve the necessary processing rates each of the 
elements 104 and 105 comprise a plurality of such 
integrated circuits operating simultaneously on diffe- 

40 rent areas of respective images. 

Element 109 designated OCT & Quantize per- 
forms the discrete cosine transfomn and quantization 
of transform coefficients and may be realized using 
integrated circuits of the type designated STV 3200 

45 DISCRETE COSINE TRANSFORM available from 
SGS-THOMSON MICROELECTRONICS. Element 
109 will also be realized with a plurality of such 
devices operated in parallel to concurrently process 
different areas of the image. 
50 Refer to FIGURE 1C and assume that frame 16 

is currently available. Previously occurring P frame 1 3 
has been snatched and stored in the buffer memory 
B 101 . In addition a generated predicted frame 13 has 
been stored in one of the buffer storage elements 114 

55 or 1 1 5. As frame 1 6 occurs it is stored in buffer mem- 
ory A, 102. In addition frame 16 is applied to a working 
buffer memory 100. As frame 16 occurs, appropriate 
image blocks of data are coupled from the memory 
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100 to the minuend input of a subtracter 108. During 
I frame compression the subtrahend input of the sub- 
tracter 108 Is held at a zero value so that data passes 
through the subtracter 108 unaltered. This data is 
applied to the DCT and quantizer element 109 which 
provides quantized transform coefficients to elements 

110 and 112. Element 112 perfomns inverse quanti- 
zation and inverse DCT transformation of the coeffi- 
cients to generate a reconstructed image. The 
reconstructed image is applied via an adder 113 to, 
and stored in, one of the buffer storage elements 114 
and 115 for use in compressing subsequent B and P 
frames. During compression of I frames no infor- 
mation is added (by adder 1 13) to the reconstructed 
Image data provided by element 112. 

Element 110 performs two functions during I 
frame compression. First it performs differential 
(DPCM) coding of the DC coefficients generated by 
element 109. It then variable length encodes (VLC) 
the differentially coded DC coefficients and zero run 
and variable length encodes the AC coefficients gen- 
erated by element 109. The VLC codewords are 
applied to a formatter 111 which segments the data 
and appends header information thereto in conform- 
ance with the layers illustrated in FIGURE 3A. Coded 
data from element 1 1 1 Is then passed to the priority 
select apparatus. Each of the elements 109, 110 and 

111 are controlled by a system controller 1 16 to cyc- 
lically perform the appropriate operations at the 
appropriate times. 

After frame 16 a "B" frame (14) occurs and is 
loaded into buffer memory 100. Data from frame 14 is 
coupled to both of elements 104 and 105. Element 
104, responsive to frame 14 data from memory 100 
and frame 13 data from memory 101 , calculates for- 
ward motion vectors for respective blocks of 16x16 
pbcels of image data. It also provides a distortion sig- 
nal which is indicative of the relative accuracy of the 
respective forward motion vectors. The forward 
motion vectors and the corresponding distortion sig- 
nals are coupled to an analyzer 106. 

Element 105, responsive to frame 14 data from 
memory 100 and I frame 16 data from memory 102. 
generates backward motion vectors and correspond- 
ing distortion signals which are also coupled to the 
analyzer 106. Analyzer 106 compares the distortion 
signals against a threshold, and if both exceed the 
threshold, provides both the forward and backward 
motion vectors as the motion vector, and also pro- 
vides a corresponding signal related to the ratio of the 
distortion signals. Upon reconstruction predicted 
images are generated using both forward and back- 
ward vectors and corresponding frame data from 
which derived. An interpolated frame is generated 
from the forward and backward predicted frames in 
accordance with the ratio of distortion signals. If the 
distortion signals for both the forward and backward 
motion vectors are less than the threshold, the motion 



vector with the corresponding lesser valued distortion 
signal is selected as the block motion vector. 

After the motion vector has been determined, it is 
applied to the motion compensated predictor 107 

5 which accesses the appropriate data block defined by 
the vector from the previously regenerated frame 16 
or frame 13 or both, stored In the storage elements 
114 and 115. This data block is applied to the sub- 
trahend input of the subtracter 108 wherein it is sut>- 

10 tracted on a pixel by pixel basis from the 
corresponding block of pixel data from the current 
frame 14 provided by the buffer memory 100. The dif- 
ferences or residues are then encoded in element 109 
and the coefficients applied to element 110. The cor- 

15 responding block vector is also applied to element 
110. For encoded B and P frames, the DC coefficients 
are not differentially encoded, but both the DC and AC 
coefficients are variable length encoded. The motion 
vectors are differentially encoded and then the diffe- 

20 rentially encoded vectors are variable length 
encoded. The coded vectors and coefficients are then 
transfenred to the formatter 111. The encoded B 
frames are not inverse quantized and inverse trans- 
formed in element 112 since they are not used for sub- 

25 sequent encoding. 

P frames are similariy encoded except that only 
forward motion vectors are generated. For example P 
frame 19 is encoded with motion vectors associating 
corresponding blocks of I frame 16 and P frame 19. 

30 During encoding of P frames, element 112 provides 
corresponding decoded residues and element 107 
provides the corresponding predicted P frame. The 
predicted frame and the residues are added in adder 
113 on a pixel-by-pixel basis to generate the recon- 

35 structed frame which is stored in the one of storage 
elements 1 14 and 1 16 not containing the frame infor- 
mation from which the predicted P frame is generated. 
The reconstructed and stored P frame is used for 
encoding subsequent B frames. For both P and B 

40 field/frames it should be noted that DCTs are perfor- 
med on a block basis (e.g., a matrix of 8x8 pixels), but 
motion vectors are calculated for macrobiocks (e.g., 
a 2x2 matrix of luminance of blocks or a 1 6x1 6 matrix 
of pixels). 

45 FIGURE 4 shows exemplary circuitry In block 

form which may be used to implement the functions 
of elements 110 and 111 of FIGURE 3. The outputfor- 
mat of this circuitry diverges from that normally pro- 
vided by an MPEG type encoder in that an MPEG 

50 output Is a bit-serial data stream, but the data pro- 
vided by the exemplary circuitry of FIGURE 4 is in par- 
allel-bit word format. This format is selected to 
facilitate the implementation of both the priority select 
processor and the transport processor. In addition two 

55 extra signals are provided which define the code type 
of each output codeword, CW. and the length. CL, of 
each codeword. 

In FIGURE 4 motion vectors from the analyzer 
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106 (FIGURE 3) are differentially encoded in the 
DPCM element 127 on a slice basis and coupled to a 
multiplexer 129 via a buffer memory 133. Transform 
coefficients from the transform element 109 are coup- 
led to a multiplexer 132 and a differential encoding 
element DPCM 128. Differentially encoded coeffi- 
cients from the DPCM 128 are coupled to a second 
input of the multiplexer 132. During encoding of P or 
B frames all of the coefficients are passed directly 
through the multiplexer 132, During encoding of I 
frames, the DC coefficients are selectively differen- 
tially encoded by the DCPM 128. The differentially 
encoded DC coefficients and the non-differentially 
encoded AC coefficients are multiplexed by the mul- 
tiplexer 1 32 and coupled to a second input of the mul- 
tiplexer .129 via the buffer memory 133. Header 
information from a format control and header element 
1 26 are coupled to a third input of the multiplexer 1 29. 
Element 126 includes stored information and control 
circuitry to a) provide the requisite header information 
for the different code layers (FIGURE 3A) and to b) 
provide control signals to time division multiplex the 
header information, motion vectors and the transform 
coefficients via multiplexer 129. Element 126 is res- 
ponsive to the system control circuitry via the control 
bus CB to provide the appropriate headers corre- 
sponding to picture size, rate, picture coding type 
quantizer parameters, etc. Certain of the header infor- 
mation Is calculated by element 126 in conjunction 
with an analyzer 125. In the MPEG-type fomnat much 
of the header information (e.g., level 5 of FIGURE 3A) 
is variable such as the type of block encoding, the 
type of motion vectors, whether a block has zero 
valued motion vectors and or whether alt coefficients 
In a block are zero values. The vector infonmation and 
coefficient infonmation is applied to the analyzer 125 
to determine these types of header information. 
Whether a motion vector is a forward, backward and 
or zero valued is directly determinable by examination 
of the vectors. Whether all coefficients in a block are 
zero valued is determinable by simply accumulating 
the magnitudes of the vectors included in a block. 
Once the type of variable header data is determined, 
it is assigned a codeword and provided to the multip- 
lexer 129 at the appropriate time. The element 126 
also provides information relating to the codeword 
type currently being multiplexed, i.e.. header infor- 
mation, motion vector information, DC coefficients, 
AC coefficients. 

The time division multiplexed information is coup- 
led to a variable length encoder 1 30 which is also con- 
trolled by element 126. In the figure the VLC control 
is shown provided by the codeword type signal. The 
different code types are variable length coded accord- 
ing to different VLC code tables and thus it is approp- 
riate to utilize the code type signal for such control. 

The VLC 130 may include a zero-run encoder for 
encoding zero runs of the AC coefficients and a 
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plurality of Huffman code tables addressed by the res- 
pective codewords passed by the multiplexer 129 for 
variable length encoding the transform coefficients 
and the motion vectors. The particular table utilized is 

5 enaibled by the code type signal. Each of the code 
tables may include corresponding tables program- 
med with the code lengths of the respective variable 
length codewords. The codewords CW and the code 
lengths CL are provided concurrently on separate 

10 busses in parallel-bit fonmat. In general the header 
information is not variable length coded and is passed 
unaltered by the VLC 130. However, the VLC 130 
includes code length tables responsive to the code 
type signal to provide the code lengths of the header 

15 codewords. Alternatively, a bit counter may be 
included in the VLC to count the number of bits of 
these data. 

The element 126 also controls the writing and 
reading of data provided to and from the buffer mem- 

20 ory133. 

FIGURE 5 illustrates exemplary apparatus for 
perfonning the priority selection process. This 
apparatus may operate in several modes. For 
example, data may be prioritized on an equal basis for 

25 the different field/frame types, or on an unequal basis 
for the different field/frame types. In the latter instance 
assume that the HP channel passes 20 percent of the 
total data transmitted and that three percent of the HP 
channel is consumed by auxiliary data. If the video 

30 data is quantized for maximum transmission channel 
efficiency, 17.53% of the video data may be allocated 
to the HP channel. In the former instance, the high 
priority data for the I, P and B frames may be assigned 
in for example, the ratio of a:p:1 respectively. The 

35 values a and p may be user selectable and/or deter- 
mined on a statistical basis from the amount of code 
data from prior encoded frames. 

Refer to FIGURES 5 and 5A. In the following des- 
cription, numbers in square brackets correspond to 

40 process blocks of FIGURE 5A. Data from the variable 
length encoder 130 is coupled to respective input 
ports of two buffer memories 150A and 150B and to 
a data analyzer 152. The respective buffers include 
enough memory to store for example a slice of data. 

45 The buffers 150A and 150B are operated in "ping- 
pong" fashion to alternately write slices of data and 
read slices of data. Thus while buffer 1 50A writes data 
from, e.g., slice n, buffer 150B reads data from slice 
n-1. 

50 As data is written to a particular buffer, the 

analyzer 152 generates a codeword number CW#i for 
each codeword and stores the CW#i in association 
with the corresponding codeword. The analyzer also 
calculates the point, or codeword, at which the data 

55 should be split between HP and LP channels. The cal- 
culation is detenmined for the amount of data stored 
in the buffer. There are four general types of data 
including Header Data. Motion Vectors, DC coeffi- 
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cients and AC coefficients. The DC and AC coeffi- 
cients over a block occur in the order of DC coefficient 
first followed by codewords representing the AC coef- 
ficients in generally descending order of importance. 
The total number of bits are counted for all the 
codewords in the buffer. Then the codeword at which 
the sum of bits is just greater than the HP percentage 
is identified by a codeword number, CW#j. This num- 
ber is applied to a switching element 153A (153B), 
and used to control the multiplexer 1 55A (1 55B). After 
the codeword number CW#j is identified, the 
codewords, codelength data, codeword type data and 
codeword numbers are read in parallel from the buffer 
150A (150B). The codewords, codelengths and 
codetypes are applied to the input of a multiplexer 
1 55A (155B), and the codeword numbers are applied 
to an input of the switching element 153A {153B). As 
the data is read from the buffer, the switching element 
153A (153B) compares the codeword numbers to the 
calculated number CW#j. For all codeword numbers 
less than or equal to CW#j, the switching element pro- 
vides a control signal which conditions the multiplexer 
1 55A (155B) to pass the corresponding data to the HP 
channel via a further multiplexer 156. For codeword 
numbers greater than CW#j, the multiplexer 155A 
(155B) is conditioned to pass the corresponding data 
to the LP channel via multiplexer 156. The multiplexer 
156 is conditioned to pass HP and LP data provided 
by the buffer 150A, (150B) which is cunrently being 
read. 

The analyzer 152 is responsive to the codelength 
signals, and the code type signals. Responsive to the 
code type signals, the analyzer generates [502] 
codeword numbers for each occurring codeword. For 
example, each codeword representing header infor- 
mation is assigned the number (-2). Each codeword 
representing motion vectors and DC coefficients are 
assigned the numbers (-1) and (0) respectively. Suc- 
cessive AC codewords are assigned ascending inte- 
gers i from 1 to n on a block-by-block basic. 

The analyzer 152 also includes an accumulator 
which, responsive to the codelength and type signals, 
independently sums the number of bits of the 
codewords of each code type entered in the buffer 
150A (150B). These sums are added [504] to provide 
the total number of codeword bits contained In the buf- 
fer. The total sum is multiplied by the decimal equiv- 
alent of the percent to be allotted to the HP channel 
to produce a check sum [512]. Thereafter the respec- 
tive code type sums are sequentially added [508] in 
ascending order of codeword number CW#i to pro- 
duce partial sums. Each partial sum is compared [51 2] 
with the check sum until the partial sum exceeds the 
check sum. The codeword number CW#j associated 
with the immediately previous partial sum is the last 
codeword within a block to be assigned to the HP 
channel [512-518]. All succeeding codewords, i.e., 
CW#j+1 to CW#n, for respective blocks are assigned 
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to the LP channel. 

Respective HP and LP data from the priority 
selector is arranged in transport blocks designed to 
enhance signal recovery and error concealment at the 

5 receiver. The transport block fonmat is illustrated in 
FIGURE 6. An exemplary HP transport block includes 
1 728 bits and an LP transport block includes 864 bits. 
Respective transport blocks may include more or less 
than a slice of data. Thus a particular transport block 

10 may include data from the end of one slice and data 
from the beginning of the next subsequent slice. 
Transport blocks including video data may be inter- 
leaved with transport blocks containing other data, 
e.g., audio. Each transport block includes a service 

15 type header ST which indicates the type of infor- 
mation included in the respective transport block. In 
this example the ST header is an 8-bit word which 
indicates whether the data is HP or LP, and whether 
the information is audio, video or auxiliary data. Four 

20 bits of the 8-bit word are used to represent the ST 
information and four bits are used to provide Ham- 
ming parity protection of the ST information bits. 

Each transport block includes a transport header 
TH immediately following the ST header. For the LP 

25 channel the transport header includes a 7-bit macrob- 
lock pointer, an 18-bit identifier and a 7-bit record 
header (RH) pointer. The transport header of the HP 
channel includes only an 8-bit record header (RH) 
pointer. The macroblock pointer is used for segmen- 

30 ted macroblock or record header components, and 
points to the start of the next decodable component. 
For example, if the particular transport block includes 
macroblock data associated with the end of slice n 
and the beginning of slice n+1, the data from slice n 

35 is placed adjacent the transport header and the 
pointer indicates that the next decodable data is adja- 
cent the transport header TH. Conversely, if a record 
header RH is adjacent the TH, the first pointer indi- 
cates the byte position following the record header 

40 RH. A zero valued macroblock pointer indicates that 
the transport block has no macroblock entry point 

The transport block may include none, one or 
more than one record header, and their positions are 
variable within the transport block. A record header 

45 occurs at the beginning of each slice of macroblock 
data in the HP and LP channel. No record headers are 
included in transport blocks that include only video 
data header information. The record header (RH) 
pointer points to the byte position containing the start 

50 of the first record header in the transport block. Note, 
the first record header in a transport block is placed 
at a byte boundary. That is, if a variable length code 
precedes the record header, the variable length code 
may be bit-stuffed to insure that the start of the record 

55 header occurs at a bit position which is an integral 
number of bytes from the beginning of the transport 
block. The record headers are placed at byte twund- 
aries to enable the decoder to locate them since they 
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are embedded in a stream of concatenated variable 
length codewords. A zero valued RH pointer indicates 
that there are no record headers in the transport 
block. If both the record header pointer and the mac- 
roblock pointer are zero valued, this state indicates 
that the transport block includes only video data 
header information. 

The 18-bit identifier in the LP transport header 
identifies the current frame type, the frame number 
(modulo 32), the current slice number, and the first 
macroblock contained in the transport block. 

Following the transport header is either a record 
header, RH, or data. As indicated in FIGURE 6 the 
record header for the video data in the HP channel 
includes the following information: A 1 -bit FLAG which 
indicates if a header extension, EXTEND, is present. 
Following the FLAG is an identifier IDENTITY, which 
indicates a) the field/frame type I, B or P; b) a 
field/frame number (modulo 32) FRAME ID; and c) a 
slice number (modulo 64) SLICE IDENTITY. Follow- 
ing the identifier the record header includes a macrob- 
lock priority break point indicator, PRI BREAK (j). The 
PRI BREAK(j) indicates the codeword number CW#j, 
developed by the analyzer 1 52 of the priority selector, 
for dividing the codewords between the HP and LP 
channels. Lastly, an optional header extension may 
be included in the HP record header. 

The record header incorporated in the LP channel 
includes only an identifier, IDENTITY, similar to the 
identifier implemented in the HP channel. 

Each transport block is terminated with a 16-bit 
frame check sequence, FCS, which is calculated over 
alt bits in the transport block. The FCS may be gener- 
ated using a cyclic redundancy code. 

FIGURE 7 illustrates exemplary apparatus of the 
transport processor. In the figure an arbiter 21 3 inter- 
leaves, via a multiplexor 212, transport blocks of video 
data from a multiplexer 21 1 , audio data from a mem- 
ory 214 and auxiliary data from a memory 215. The 
audio data is provided in transport block form by the 
source 216 and applied to a first-in first-out memory 

214. The auxiliary data is provided in transport block 
form by the source 217 to a first-in first-out memory 

215. The fonmats of the audio and auxiliary data trans- 
port blocks may differ from the format of the video 
transport blocks, however all transport blocks will 
include a leading service type header, and preferably 
will be of equal length. The arbiter 21 3 responds to the 
level of occupancy of buffers 214, 215 and 207 in such 
fashion to insure that none of these buffers overflow. 

The apparatus of FIGURE 7 operates on one of 
the HP or LP signals and similar apparatus is required 
for the alternate signal. However, if all of the audio and 
auxiliary signal is HP data an arbiter for interleaving 
transport blocks will not be included in the LP trans- 
port block processor and vice versa. 

In FIGURE 7, codeword, CW, codelength, CL, 
and code type, TYPE, data from the priority selector 



are coupled to a transport controller 218, and the 
codewords and code type signal are coupled to a vari- 
able word length to fixed word length converter 201. 
The donvertor 201 packetizes the variable length 

5 codewords into, for example, 8-bit bytes in order to 
reduce the amount of storage space required of the 
rate buffers 13 and 14. The converter 201 may be of 
the type described in US Patent No. 4,914,675. The 
fixed length words provided by the converter 201 are 

10 temporarily stored in the buffer 207. As the variable 
length codewords are converted to fixed word 
lengths, the code types are monitored to locate the 
last data from respective slices to insure that the cor- 
responding fixed length word does not include data 

15 from the next occunring slice. If this fixed length word 
is not filled with data bits it is bit stuffed. In addition this 
last fixed length word is indexed so that upon being 
read from the buffer 207 it is identified as the end of 
a slice. The index corresponds to the byte number 

20 relative to the first occurring fixed length word written 
in the buffer 207. 

The transport controller 218 responds to the CW, 
CL, TYPE and CW#j data, and the end of slice index, 
to construct the transport block headers (ST, TH, RH) 

25 and applies these headers to a header buffer 208, 
which may be internal to the controller 218. The con- 
troller 21 8 may include dedicated registers for the par- 
ticular types of transport header data, and when the 
appropriate video header data occurs (identified by 

30 the TYPE codes) this data is written to the respective 
registers. When formation of the respective transport 
headers is completed, they are written to the header 
buffer 208. The ST header data may be programmed 
in the controller 218 in Hamming coded format The 

35 transport headers TH, ST and RH and the FCS are a 
fixed number of bytes. In fomning the transport blocks 
the controller 21 8 reads the transport headers ST and 
TH from the buffer 208 and provides same via the mul- 
tiplexer 209. If an end of slice index is not associated 

40 with the first most data in the buffer 207. data from the 
buffer 207 is read and provided via the mutiplexer 
209. Immediately after an end of slice indexed byte is 
read from the buffer 207. the header RH is read from 
the header buffer 208 and included in the output data 

45 stream via the multiplexer. The buffer 207 and multip- 
lexer 209 are then condition to provide subsequent 
fixed length video data words. As respective header 
and video data are provided, the number of bytes are 
counted, and data output for a respective transport 

50 block is terminated when the count reaches the num- 
ber of bytes allocated per transport block (less the 
number of bytes for the FCS code). 

The transport blocks provided by the multiplexer 
209 are coupled to one input of the multiplexor 211 

55 and to the input tenminal of a frame check sequence 
coder FCS 210, the output of which is coupled to a 
second input of the multiplexer 211. The FCS 210, 
responsive to transport block data forms two- byte 
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error check codes for respective transport blocks. The 
multiplexer 211 is conditioned to pass respective 
transport blocks provided by the multiplexer 209, and 
then to append the 16-bit or two-byte FSC code from 
element 210 to the end of the transport block. 

In the foregoing description of the transport pro- 
cessor it is assumed that all of the header information 
provided by the compressor 10 is included in the video 
data stream provided by the transport processor. It 
should be recognized that much of the video data 
header infonmation is also included in the transport 
headers and as such provides redundant information. 
In an altemative arrangement, the controller 218 may 
preclude the converter 201 from accepting video 
header data which would be redundantly included in 
the transport block headers, thus enhancing the over- 
all coding efficiency. At the receiver the excised video 
header data may be reconstructed from the transport 
block header information and reinserted in the video 
data stream. 

At the receiver, detected signal is applied to for- 
ward error correction circuits 21 and 22 to perform 
en-or correction on the respective HP and LP signals. 
Error corrected data is then applied to the transport 
processor 25 via rate buffers 23 and 24. Even though 
the detected data has undergone error correction in 
the FEC circuits 21 and 22. certain errors occurring 
during signal transmission may not be correctable by 
the FEC circuits. If these errors are allowed to pass to 
the decompression circuitry, very objectionable cor- 
ruption may occur in the reproduced image. To prec- 
lude such happenstance each transport block 
includes independent error detection codes to identify 
the occurrence of errors which pass through the FEC 
circuits, and responsive to such error indications the 
system may provide appropriate error concealment. 

FIGURE 8 illustrates the transport processor 25 
included in the receiver portion of the system. Two 
such processors are required, one for the HP channel 
and one for the LP channel. If it is known a priori that 
audio or auxiliary data will always be excluded from a 
particular channel, the corresponding elements may 
be eliminated from such channel transport processor. 

The FEC circuits 21 and 22 provide the received 
data in fixed length words corresponding to the fixed 
length words provided to the FEC circuits 15 and 16 
of the encoder. As such the transport block header 
data occurs on byte boundaries which are either pre- 
detenmined (ST, TH and FCS) or are identified (RH) 
by the transport header. This data format facilitates 
identification and processing of the requisite transport 
blocks. 

In FIGURE 8 data from the rate buffer 23 or 24 is 
applied to an FCS ERROR detector 260 and a delay 
element 251. Delay element 251 provides a delay of 
one transport block interval to allow the detector 250 
to determine if any errors are present in the corre- 
sponding transport block. The detector 250 provides 



an error signal E indicating the presence or absence 
of errors in the transport block. The error signal is 
applied to the input port of a one-to-three demultip- 
lexer-253. The delayed transport block data is also 

5 applied to the input port of the multiplexer 253. 
Delayed transport block data is also coupled to a ser- 
vice type detector (ST DETECT) 252. which examines 
the ST header and responsive thereto conditions the 
multiplexer 253 to pass the transport block data and 

10 corresponding error signal to the appropriate one of 
the audio, auxiliary or video signal processing paths. 
The detector 252 includes Hamming error correction 
circuitry and therefor, even though an enror may be 
detected in a transport block, the ST code may still be 

15 relied upon because of its independent Hamming 
code protection/correction. 

In the respective audio, auxiliary and video signal 
processing paths the error signal may be utilized in 
different ways to effect error concealment. In the 

20 video signal processing path the error signal may be 
utilized in alternative ways depending upon the error 
concealment circuitry included in the decompressor 
27. In the simplest case assume that the decompres- 
sor 27 includes a display memory in which infonmation 

25 is updated as information is decoded. If no information 
is received for a particular portion of an image, the cor- 
responding portion of the display memory is not 
updated. Those image portions that are not updated 
I are simply repeated in successive frames until new 

30 data is received. If it is assumed that enror conceal- 
ment by repeating information from frame-to-frame is 
acceptable, in the video signal processing path the 
enror signal may be utilized to simply excise transport 
blocks with detected errors from the video data 

35 stream. Alternatively, for more sophisticated error 
concealment the transport block data may be retained 
but tagged with the error indication to alert the decom- 
pressor to perform altemative error concealment 
functions. 

40 In the video signal processing path, the transport 

block data and error signal are coupled to a transport 
controller 256, and the transport block data is coupled 
to a first-in- first-out memory (FIFO) 257 The control- 
ler 256 reads the transport header data (the first 

45 occurring predetermined number of bytes) and stores 
it in intemal memory. The controller monitors the RH 
pointer in the header data to determine its location in 
the transport block data stream. After reading the 
transport header data, the controller 256 conditions 

so the FIFO 257 to accept video data codewords until the 
occunrence of the first RH (if present) as indicated by 
the RH pointer. The controller reads the RH and pre- 
cludes it from being written to the FIFO. Thereafter the 
FIFO is conditioned to accept the remainder of the 

55 video data from the transport block. Video data from 
the FIFO 257, and transport header data and the error 
signal from the controller 256 are provided to the 
priority deselect. The controller may be arranged to a) 
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provide video data from transport blocks in which 
eaors have been detected, or b) to delete entire trans- 
port blocks in which errors have been detected and 
provide only the error indication for such blocks. 

FIGURE 9 illustrates an exennplary priority 
deselect processor. The priority deselect processor 
accepts data from the receiver transport processor 
and reconfigures it to the form applied to the encoding 
priority select processor 1 1 . In order to do so respec- 
tive codewords of the data stream have to be iden- 
tified, that is the codeword CW#j in each block must 
be detectable. Since the data is in the fonm of concate- 
nated variable length codes, it must be at least par- 
tially VLC decoded to define the codeword 
boundaries. Once the codeword boundaries are 
determined, the codewords may be counted to find 
CW#j (in the HP channel). After the codeword bound- 
aries are identified the codewords may easily be 
parsed into respective parallel-bit VLC code fonn. 

In FIGURE 9 similar circuits (270, 271, 272, 273) 
and (276, 277, 278, 279) responsive to HP and LP 
data respectively, parse the incoming data into paral- 
lel-bit VLC codewords. The HP and LP codewords are 
respectively coupled to a multiplexer 274 which, res- 
ponsive to a deselect controller 275 recom bines the 
data into a data sequence similar to that provided by 
the compressor 1 0. 

Consider the HP channel circuitry 270-273. Video 
data from the element 256 (FIGURE 8) is applied to a 
buffer memory 270 and a deselect controller 271. In 
addition the HP transport block headers are applied to 
the controller 271. The video data, absent errors, will 
occur in predetermined cyclical sequences. Particular 
points in a sequence are identifiable from the trans- 
port block header information. Once a start point is 
identified, decoding proceeds in the predetermined 
sequence. The deselect controller 271 is progrann- 
med to condition the variable length decoder VLD for 
operation according to this sequence. For example, 
assume that the transport header indicates that cur- 
rent data is from an I field and that a record header 
occurred at byte z. The record header was placed at 
the beginning of a slice, thus the entry point of a slice 
can be identified relative to byte z. At this point the 
slice header of known bit/byte coding format is known, 
which header is followed by a macroblock header of 
known bit/byte coding fonmat, followed by block data 
in known coding format, and so on. Thus, responsive 
to the transport header information the controller 271 
establishes the decoding sequence of the VLD 272, 
i.e.. which VLD decoding tables to use for which 
grouping of VLC codewords. Note that since, e.g., the 
slice header in the data stream is not variable length 
encoded, the controller may be arranged to compare 
common slice header infonmation with transport 
header information for entry point confirmation. 

The video data from the buffer 270 is coupled to 
the VLD 272 which concatenates a number of the 
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fixed length codewords, and examines the leading 
bits of the concatenated codewords for a recogniz- 
able codeword according to the type of coding expec- 
ted vis-a-vis the nomnal cyclical sequence. Once a 

5 particular number of leading bits is recognized as a 
valid codeword, these bits are output as a parallel-bit 
codeword CW to a buffer store 273. In addition the 
expected codeword type, T, and codeword length CL 
are produced and applied to the buffer store 273. As 

10 the codewords are loaded into the buffer store 273 
they are indexed by the deselect controller 275. 

DC and AC coefficient codewords are encoded 
according to different statistics, and the coefficients of 
respective blocks within a macroblock are concate- 

15 nated without including end of block identifiers. In 
general however the DC coefficient of the first block 
in a macroblock is identifiable by its position within the 
bit stream. The VLD cannot discern between the last 
AC coefficient of one block and the DC coefficient of 

20 the next block. Identification is provided by the CW#j 
included in the transport block header information. 
The CW#j identifies the last AC coefficient codeword 
in each block in a slice. To find the codeword nunv 
bered (j) the deselect controller 275 monitors the code 

25 types T provided by the VLD. The controller 275 
counts the AC type codes T, and when j have occur- 
red the controller 275 communicates with the VLD 

272 to reset the cycle to a DC coefficient decoding 
event 

30 Elements 276-279 in the LP channel operate in a 

similar manner. The LP data however is expected to 
include only AC coefficient codewords. The AC 
codewords for respective blocks within a macroblock 
are separated by end of block (EOB) codes, hence 

35 there is no need to count codewords. The operation 
of VLD 278 may simply be to decode words which are 
all coded according to one coding table. The position 
of the first macroblock in transport block is identified 
by the respective transport header, and each succes- 

40 sive macroblock is identified by record headers. This 
infonmation is evaluated by the deselect controller 277 
for controlling the VLD 278 for indexing the 
codewords in the storage buffer 279. 

Responsive to the indexed infonmation and the 

45 type T codewords stored in the storage buffers 273 
and 279, the deselect controller 275 concatenates the 
HP and LP codewords stored in the storage buffers 

273 and 274 via a multiplexer 274. The controller 
identifies a macroblock. conditions the multiplexer 

50 274 to pass data firom the HP channel and reads the 
respective HP data from storage buffer 273 up to 
codeword CW#j of block one of the macroblock. It 
then conditions the multiplexer to pass data from the 
LP channel and reads the AC coefficient codewords 

55 corresponding to the same block one, until an EOB 
type code occurs. Thereafter controller 275 condi- 
tions the multiplexer 274 to pass data from the HP 
channel and commences reading HP data con-e- 
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spending to block two of the macroblock. After the 
codeword corresponding to CVV#j is read, the control- 
ler again switches to read LP data for block two from 
the LP channel, etc. 

If while reading data from the high priority channel 
an EOB code occurs before the codeword corre- 
sponding to CW#j occurs, the controller 275 is reset 
to read the next block of data from the high priority 
channel. 

The cyclic nature of occurring codewords may be 
variable. For example some macroblocks within a 
slice may not be coded and/or some blocks within a 
macroblock may not be coded. This information is 
Included in the respective slice and macroblock head- 
ers. In order to establish and maintain the appropriate 
decoding cycles, the controller 275, responsive to the 
codeword types examines the slice and macroblock 
header codewords to detemnine the numbers of 
blocks in respective macroblocks and the number of 
macroblocks in respective slices. Responsive to 
these numbers the controller 275 counts particular 
decoding operations and determines when certain 
decoding functions have been completed, and res- 
tarts a decoding cycle. Note that as indicated previ- 
ously more than one record header may be included 
in a transport block, but only the first record header is 
identified by the transport block header, as such only 
the first record header in a transport block may be 
excised by the element 256. In order to identify and 
extract the information from such record headers, and 
excise such record headers from the data stream, the 
controller 275 counts the number of macroblocks pro- 
cessed by the VLD 272, and on completion of the last 
macroblock in a slice recognizes the next occurring 
data in a transport block as a record header. It there- 
after reads the information in the record header, to 
establish subsequent cyclic operations, and prec- 
ludes its passage to the buffer 273. 

The controllers 271 . 275 and 277 are indicated in 
the figure as three separate elements, however it 
should be appreciated that they may be subsumed in 
a single controller element 

The circuitry of FIGURE 9 does not provide vari- 
able length decoded data but rather only parses res- 
pective variable length codewords, and provides them 
in a form similar to the data provided at the output of 
the compressor 10. As such circuitry substantially 
complementary to compressor 10 may be utilized for 
the decompressor 27. It should be recognized how- 
ever that the circuitry of FIGURE 9 may be arranged 
to provide decoded variable length codes obviating a 
VLD in the decompressor circuitry. 

In the FIGURE 9 provision is made for a variety 
of error concealment methodologies. For example, 
even though a transport block includes an error, the 
data for that block may be processed and passed on 
to the decompressor. In this instance an error flag is 
generated for each data word of the transport block 
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and carried along with the codewords applied to the 
decompressor. The error flags are provided by the 
deselect controllers 271 and 277 and coupled to the 
buffer stores 273 and 279, wherein they are stored in 
5 memory locations corresponding with the associated 
erroneous transport block codewords. 

In an alternative system wherein corrupted trans- 
port blocks are not processed, assume that a LP 
transport block is lost The LP channel provides coef- 
10 ficient data of lesser importance to the reconstruction 
of images, and in fact DCT blocks may be decompres- 
sed without these coefficients, albeit the respective 
decompressed blocks will exhibit less spatial resol- 
ution. Therefore, when LP erroneous transport blocks 
15 are excised from the data stream, and data is being 
reconstructed at the multiplexer 274, after each block 
codeword CW#j of HP data, an EOB code is inserted 
in lieu of LP data. The EOB code is provided by the 
controller 275 and multiplexed into the data stream via 
20 the multiplexer 274. To indicate that the EOB for the 
respective blocks is a forced or artificial EOB, an error 
flag may be carried along with the EOB signal. The 
forced EOB signal is designated EOBE. 

The controller 275 is provided the transport 
25 header information for both channels and indexes the 
block information available in the storage buffers 273 
and 279. The macroblock and block data occur in a 
known sequence, enabling the controller to recognize 
lost data, and to provide and append EOBE codes to 
30 the HP data for lost LP data. 

In general very few errors are expected to occur 
in the HP channel due to the robustness by which it 
is transmitted. However, if an error does occur in the 
HP channel, the data in the LP chanrel corresponding 
35 to blocks of data lost in the HP channel becomes 
meaningless. The controller 275 is programmed to 
recognize lost HP data via an interruption of the nor- 
mal sequence of information identified by the noner- 
roneous transport block headers. When lost HP data 
40 is detected, the corresponding LP data is flushed from 
the storage buffer 279. that is, it is not passed on to 
the decompressor. In addition, the controller 275 may 
be arranged to provide error data to the decompres- 
sor, in a fomn which identifies lost information, i.e., 
45 macroblock or slice or frame data which are not being 
provided from the priority deselect processor. 

The controller 275 is responsive to the overall 
system controller via the control bus CB, to initialize 
or reinitialize the controllers 271. 277 and VLD's 272. 
50 278 on start up and channel changes, etc. In addition 
the controller 275 communicates with the transport 
processor 25 and rate buffers 23 and 24 for controlling 
the rate of information provided to the priority deselect 
circuitry. 

55 FIGURE 10 illustrates an exemplary arrangement 

of the decompression apparatus 27. 

Error concealment will not be discussed with res- 
pect to this apparatus as it is not the subject of this 

12 
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invention. Suffice it to say that enror data from the 
priority deselect processor is applied to the decom- 
pression controller 302 to preclude updating areas of 
the video display RAM 318 corresponding to missing 
blocks of data, and thatthe apparatus res ponds to for- 
ced EOB codes as if they are normally occurring EOB 
codes. 

Generally the circuitry of FIGURE 10 is arranged 
to decompress video data provided in MPEG-like 
hierarchical fomnat. The video data provided by the 
multiplexer 274 of the priority deselect processor is 
applied to a buffer memory 300. This data is accessed 
by the decompression controller 302 wherein header 
data is extracted to program the controller 302. The 
variable length codewords corresponding to DCT 
coefficients are extracted and applied to a variable 
length decoder (VLD) 308 and the variable length 
codewords corresponding to motion vectors are 
applied to the variable length decoder (VLD) 306. The 
VLD 308 contains apparatus for performing variable 
length decoding, inverse run length decoding and 
inverse DPCM coding as appropriate under the con- 
trol of the controller 302. Decoded data from the VLD 
308 are applied to an inverse DCT circuit 310 which 
includes circuitry to inverse quantize the respective 
DCT coefficients and to convert the coefficients to a 
matrix of pixel data. The pixel data is then coupled to 
one input of an adder 312, the output of which is coup- 
led to the video display ram 318 and buffer memories 
314 and 316. 

The VLD 306 includes circuitry to decode the vari- 
able length encoded motion vectors and to perform 
inverse DPCM coding of the motion vectors as 
appropriate under the control of the controller 302. 
Decoded motion vectors are applied to a motion com- 
pensated predictor 304. Responsive to the motion 
vectors the predictor accesses corresponding blocks 
of pixels stored in one (forward) or both (forward and 
backward) of the buffer memories 314 and 316. The 
predictor provides a block of data (from the one of the 
buffer memories) or an interpolated block of data 
(derived from respective blocks from both buffer 
memories) to a second input of the adder 312. 

Decompression is performed as follows. If a 
field/frame of input video data is intraframe encoded 
there are no motion vectors and the decoded DCT 
coefficients correspond to blocks of pixel values. Thus 
for intraframe encoded data the predictor 304 applies 
a zero value to the adder 312 and the decoded DCT 
coefficients are passed unaltered by the adder 31 2, to 
the video display RAM where they are stored for read- 
out according to normal raster scanning. The decoded 
pixel values are also stored in one of the buffer 
memories 314 and 316 for use in forming predicted 
image values for decoding motion compensated 
frames (B or P). 

If a field/frame of input data corresponds to a for- 
ward motion compensated P field/frame, the decoded 



coefficients correspond to residues or differences be- 
tween the present field/frame and the lastmost occur- 
ring I frame. The predictor 304 responsive to the 
decoded motion vectors accesses the corresponding 
5 block of I firame data stored in either buffer memory 
314 or 31 6 and provides this block of data to the adder 
wherein respective blocks of residues provided by the 
inverse DCT circuit 310 are added to the correspond- 
ing block of pixel data provided by the predictor 304. 
10 The sums generated by the adder 312 con-espond to 
the pixel values for the respective blocks of the P 
field/frame, which pixel values are applied to the dis- 
play RAM 318 to update respective storage locations. 
In addition the pixel values provided by the adder 312 
15 are stored in the one of buffer memories 314 and 316 
not storing the I field/frame of pixel data utilized to 
generate the predicted pixel data. 

For bidirectionally encoded (B) field/frames the 
operation is similar, except predicted values are 
20 accessed from the stored I and P pixel data stored in 
both buffer memories 314 and 316 depending upon 
whether the respective motion vectors are forward or 
backward vectors or both. The generated B 
field/frame pixel values are applied to update the dis- 
25 play RAM 31 8. but are not stored in either of the buffer 
memories, as B field/frame data is not utilized for 
generating other field/frames of picture data. 

FIGURE 1 1 illustrates exemplary modem circuitry 
for both the transmitting and receiving ends of the sys- 
30 tern. HP and LP data from the forward error conrection 
circuits 15 and 16 are applied to respective 64 QAM 
modulators 400 and 401 . The modulator 400 provides 
an HP analog signal with a -6dB bandwidth of 
approximately 0.96 MHZ. This signal is applied to a 
35 1.5 MHZ band pass filler 402 to eliminate high fire- 
quency harmonics, and then is applied to an analog 
signal summer 405. The modulator 401 provides an 
LP analog signal with a -6dB bandwidth of approxim- 
ately 3.84 MHZ. This signal is applied to a 6 MHZ band 
40 pass filter 404 to eliminate high frequency harmonics, 
and then is applied to an attenuator 406. The 
attenuator 406 reduces the amplitude of the LP 
analog signal by approximately 9dB relative to the HP 
analog signal. The attenuated LP signal is then coup- 
45 led to the analog signal summer 405, wherein it is 
summed with the analog HP signal to produce a signal 
with a frequency spectrum similar to the signal spec- 
trum shown in FIGURE 1. The combined signal is 
applied to a mixer 407 wherein it is multiplied by an 
50 RF carrier to frequency translate the combined signal 
to a frequency band that comports with a standard TV 
transmission channel. The translated signal is then 
applied to a band pass filter 408. which tailors the 
spectral characteristics of the frequency translated 
55 signal to fit within the standard channel. 

At the receiver, the transmitted signal is detected 
by a tuner/IF circuit 410 of conventional design, and 
applied to a PLL circuit 413 and an analog-to-digital 
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converter (ADC) 412. The digitized signal is coupled 
to respective 64 QAM demodulators 41 4 and 415. The 
demodulators 414 and 415 include band pass filters 
at their respective input connections to band limit the 
spectrum of the signals to be processed thereby to 
conform to the nominal signal spectrum of the HP and 
LP signals. The demodulators 414 and 41 5 are of con- 
ventional QAM demodulator design and are respon- 
sive to clock signals provided by the PLL circuit 413. 
The PLL 413 develops the requisite clock signals via 
phase locking a signal developed by a voltage control- 
led oscillator to one of the two carriers attendant the 
QAM signals. 

The invention has been described in temis of an 
MPEG like signal however It should be appreciated 
that it is amenable to processing signals compressed 
in other fomnats and by other transforms. The only 
requirement on the type of compression is that it pro- 
vide data that can be prioritized in hierarchical levels, 
as for example sub band or pyramid transforms. 



Claims 

1. In a video signal encoding system, wherein 
encoded video signal occurs, at least in part, as 
a succession of groups of data (e.g., slices), whe- 
rein each group includes a plurality of subgroups 
(e.g., blocks) of interdependent coded data rep- 
resenting a contiguous area of an image, 
apparatus for arranging encoded video signal 
data in transport blocks, characterized by: 

a source (1 1 ,1 56) of encoded video signal 

data; 

first means (207,218), responsive to said 
encoded video signal data, for dividing the 
encoded video data into segments of substan- 
tially equal amounts of data, respective segments 
representing encoded video data to be included 
in respective transport blocks, respective seg- 
ments including video data from one or more of 
said groups, and wherein subgroups of data from 
ones of said groups may be in more than one seg- 
ment; 

second means (218.208). for generating 
transport headers including information to identify 
first occurring groups of data in respective seg- 
ments, and for generating further headers includ- 
ing information identifying second occurring 
groups of data in respective segments which 
include data from first and second groups of data, 
said further headers to be located between first 
and second groups of data in respective transport 
blocks, said second means also generating, and 
including in respective transport headers, infor- 
mation indicating the location of said further 
headers in respective transport blocks; 

third mean (209). cooperating with said 



first and second means, for multiplexing respec- 
tive transport headers with corresponding seg- 
ments and further headers to form partial 
transport blocks, with respective transport head- 

5 ers located in a predetermined location in respec- 

tive transport blocks; and 

error encoding means (210), responsive to 
header information and encoded video data in 
respective partial transport blocks, for generating 

10 error check codes over respective partial trans- 

port blocks, and appending said error check 
codes to conresponding partial transport blocks to 
form said transport blocks. 

15 2. The apparatus set forth in claimi characterized in 
that; said second means generates and includes 
in said transport headers, information for detect- 
ing errors in at least a portion of said transport 
headers. 

20 

3, The apparatus set forth in claim 2 further charac- 
terized by; forward error check means (e.g., a 
REED-SOLOMAN coder) for generating en-or 
detection/correction codes over said transport 

25 blocks, and appending said error detection/cor- 

rection codes to the blocks of data over which the 
error detection/correction codes were generated. 

4. In a video signal system for processing encoded 
30 video signal data conveyed in transport blocks, 

said transport blocks including a first transport 
header TH in a predetermined transport block 
location, a second transport header RH placed at 
variable locations within said transport blocks. 

35 which variable location is identified by a pointer in 

said first transport header, and an error check 
code located in a predetermined location in said 
transport block, apparatus characterized by: 

means (20) for receiving and providing 

40 conveyed transport blocks; 

error check means (250), responsive to 
said received transport blocks, for performing an 
error check on respective transport blocks in 
cooperation with associated error check codes, 

45 and providing an error indicating signal upon the 

detection of bit errors in said transport blocks; 

control means (256,257), coupled to said 
error check means, for excising said error check 
codes from respective transport blocks, extract- 

50 ing said transport header TH from respective 

transport blocks and determining therefrom the 
location within said transport blocks of said trans- 
port headers RH, and extracting said transport 
header RH from respective transport blocks, and 

55 including means for providing encoded video sig- 

nal included within said transport blocks exclu- 
sive of said extracted transport block headers and 
said error check codes. 
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5. The apparatus set forth in claim 4 characterized 
in that; said control means further includes means 
responsive to said error indicating signal for exci- 
sing video signal transport blocks in which errors 

are detected. 5 

6. The apparatus set forth in claim 4 characterized 
in that; at least a portion of the first transport 
header is Hamming code protected and the con- 
trol means includes Hamming code error correc- io 
tion circuitry. 

7. The apparatus set forth in claim 4 characterized 
in that; the signal processed by the system 
includes transport blocks of different signal types is 
(e.g. video, audio etc.) and said control means 
includes means responsive to said first transport 
header for parsing the transport blocks of diffe- 
rent signal types into respective signal paths. 

20 

8. The apparatus set forth in claim 4 characterized 
in that; the encoded video signal includes a sequ- 
ence of transport blocks which have undergone 
forward error correction processing and forward 
error correction codes are appended thereto, and 25 
said means for receiving includes forward error 
processing circuitry, responsive to said forward 
error correction codes, for correcting at least a 
portion of enrors incurred in conveying the 
encoded video signal data. 30 

9. The apparatus set forth in claim 4 characterized 
in that; said error check means, excises transport 
blocks which include errors and passes transport 
blocks which are free of errors; and 35 

including means, responsive to error free 
transport blocks, for separating transport headers 
and further headers from encoded video data. 

10. The apparatus set forth in claim 9 characterized 40 
in that; the encoded video data is conveyed in 

high and low priority channels of transport blocks 
of interdependent video data, with respective 
groups of data being conveyed in part in the low 
priority channel and in part in the high priority 45 
channel; and means, responsive to separated 
transport headers, for excising video data from 
error free transport blocks, including means for 
excising groups of error free video data in the low 
priority channel conresponding to groups of data so 
in the high priority channel which have been 
excised. 
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